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Budget Feasible Mechanism Design via Random Sampling 
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O ! Abstract 

Budget feasible mechanism considers algorithmic mechanism design questions where there is 
C^ I a budget constraint on the total payment of the mechanism. An important question in the field is 

that under which valuation domains there exist budget feasible mechanisms that admit 'small' 
approximations (compared to a socially optimal solution). Singer |20| showed that additive 
and submodular functions admit a constant approximation mechanism. Recently, Dobzinski, 
Papadimitriou, and Singer |10| gave an 0(log n) approximation mechanism for subadditive 
functions and remarked that: "A fundamental question is whether, regardless of computational 
t~^ I constraints, a constant-factor budget feasible mechanism exists for subadditive function. " 

In this paper, we give the first attempt to this question. We give a polynomial time 0( io°iq"„ ) 

c/3 ■ sub-logarithmic approximation ratio mechanism for subadditive functions, improving the best 

' known ratio 0(log n). Further, we connect budget feasible mechanism design to the concept of 

approximate core in cooperative game theory, and show that there is a mechanism for subaddi- 

CN I tive functions whose approximation is, via a characterization of the integrality gap of a linear 

program, linear to the largest value to which an approximate core exists. Our result implies 

in particular that the class of XOS functions, which is a superclass of submodular functions, 

O^ ■ admits a constant approximation mechanism. We believe that our work could be a solid step 

O^ I towards solving the above fundamental problem eventually, and possibly, with an affirmative 

r — ■ answer. 
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1 Introduction 

Consider a scenario where a company is running a set of machines and each of which serves a set 
of jobs. There is an incurred expense for each machine to serve the jobs, and the total expense of 
the company is the sum of the expenses of ah machines. Assume now the company would like to 
save its running expense by removing some of served jobs and paying those jobs a certain amount 
of subsidy. We may assume that every job has a cost of being not served (or equivalently, benefit 
of being served); the bottom line is therefore to have their cost compensated. The question that 
the company considers is that which jobs should be chosen such that the saved expense as much as 
possible given a universal budget constraint. 

Formally, there is a set of agents (i.e., jobs) A, and for any subset S (^ A there is a public 
known valuation v{S). (In the above example, v{S) gives how much expenses it can be saved if S 
is removed.) Each agent i ^ A has a cost c(i), which gives an incurred cost to the agent if he is 
selected. This defines a natural optimization problem, i.e., find a subset S that maximizes v{S) 
subject to X]ig5 '^(0 — -^' where S is a sharp budget which gives an upper bound of compensation 
that can be distributed among agents. The budgeted optimization problem has been considered 
in a variety of domains with respect to different valuation functions, e.g., additive (i.e., knapsack), 
submodular, and subadditive. 

However, agents, as self-interested entities, may want to get as much subsidy as possible. In 
particular, they can hide their true incurred cost c{i) (which is known only by themselves) and 
claim 'any' amount, say b{i). We therefore adopt the approach of mechanism design to manage 
self-interested, but strategic, behaviors of the agents. Specifically, given submitted bids h{i) from 
all agents, a mechanism decides a winner set S and a payment p[i) to each winner i. A mechanism 
is called truthful (a.k.a. incentive compatible) if it is a dominant strategy for every agent to submit 
his true cost, i.e., h{i) = c{i). Truthfulness is one of the central solution concepts in mechanism 
design; it ensures that every participant will behave precisely according to the mechanism protocol 
and his true interest. 

Our problem has an important and practical extra ingredient: Budget, i.e., the total payment of 
a mechanism should be upper bounded by B. The budget constraint introduces a new dimension 
to mechanism design and restricts the space of truthful mechanisms. For example, in a single 
parameter domain, a monotone allocation rule plus its associated threshold payment, while still 
gives a sufficient and necessary condition for truthfulness [16] . may not necessarily generate a 
budget feasible solution. Thus, a number of well known truthful designs (e.g., the seminal VCG 
mechanism [211 El [I^) do not apply, and new ideas have to be developed. 

Another significant change due to the budget constraint is that, unlike the VCG mechanism 
which always generates a socially optimal solution, we cannot hope to have an output which is both 
socially optimal and budget feasible even if we are given unlimited computational power. Indeed, 
in a simple example like path procurement (whose valuation v{-) is a super additive function), any 
budget feasible mechanism can have an arbitrarily bad solution. Therefore, the question that one 
may ask is that under which valuation domains there exist budget feasible truthful mechanisms 
that admit 'small' approximations (compared to a socially optimal solution). 

The answer to the question crucially depends on the properties and classifications of the con- 
sidered valuation function. In particular, given the following hierarchy for the functions [15| : 



additive C gross substitutes C submodular C XOS C subadditive, 
which one admits a positive answer? Singer [20] initiated the study of approximate budget feasible 



mechanism design and gave constant approximation mechanisms for additive and submodular func- 
tions. In recent work, Dobzinski, Papadimitriou, and Singer [10] considered subadditive functions 
and showed an 0(log n) approximation mechanism. Further, it was remarked that: 

"A fundamental question is whether, regardless of computational constraints, a constant- 
factor budget feasible mechanism exists for subadditive function. " 

— Dobzinski, Papadimitriou, Singer |10] 

Our Results. In this paper, we give the first attempt to this question. Our first result is a sub- 
logarithmic approximation ratio mechanism for subadditive functions, improving the best known 
ratio 0(log n). 

Theorem 1. There is a polynomial time budget feasible truthful mechanism for subadditive func- 
tions with an approximation ratio o/0( ^^°^"^ ), where n is the number of agents. 

Here we assume that we are given an demand oracle for the subadditive valuation function. 
This is in the same setting as the mechanism in [10] since it was proved that a value oracle is 
not sufficient [20]. The sub- logarithmic approximation further sheds light on the hope of a positive 
answer to the above question. We continue to explore budget feasible mechanisms under the domain 
of XOS and subadditive functions. Consider the following linear program (LP), where a(-)'s are 
variables. 

min y^ a{S) ■ v{S) 
SCA 

s.t. a{S) > 0, y S CA 

Y, a('5) > 1, y ieA 

S: i&S 

In the above LP, if we consider each a{S) as the fraction covered by the subset S, the last constraint 
requires that all items in A are fractionally covered; hence, it describes a linear program for the 
set cover of A. An important observation of the LP is that for any subadditive function v{-), the 
value of the optimal integral solution is precisely v{A). 

The above LP has a strong connection to cores of cost sharing games (considering v{-) instead 
as a cost function), which is a central notion in cooperative game theory [T2]. Roughly speaking, 
the core of a game is a stable cooperation among all agents to share v{A) where no subset of agents 
can benefit by breaking away from the grand coalition. It is well known that the cores of many 
cost sharing games are empty. This motivates the notion of a-approximate core, which requires all 
the agents to share only a fraction of v{A). The classic Bondareva-Shapley Theorem [11 [19] says 
that for subadditive functions, the largest value a for which the a-approximate core is nonempty is 
equal to the integrality gap of the LP. Further, the integrality gap of the LP is one (i.e., v{A) is also 
an optimal fractional solution) if and only if the valuation function is XOS; this is also equivalent 
to the non-emptiness of the core. 

Given an instance of our problem with agents set A, we may consider the above LP and its 
integrality gap for every subinstance A' C A; among which the largest integrality gap characterizes 
the worst scenario between the optimal integral and fractional solution of the problem. Our second 
result is the following. 



Theorem 2. There is a budget feasible truthful mechanism for subadditive functions with approxi- 
mation ratio linear to the largest integrality gap over all subinstances of the above LP. In particular, 
for XOS functions, the mechanism has a constant approximation ratio. 

For some special subadditive functions whose integrality gaps are bounded by constants (XOS is 
one such example), our mechanism will have a constant approximation. Note that the mechanism 
may have exponential running time. For some special XOS functions like matching and clique, 
the mechanism can be implemented in polynomial time (given a demand query to the valuation 
function, see Section [6]). Further, our mechanisms also work for non-monotone functions and a 
generalized subadditive functions (see Section [5]). 

Our results show an interesting connection between budget feasible mechanism design and 
integrality gap, as well as the existence of a-approximate core. While our mechanisms do not 
answer the above fundamental question posed in [10] directly, we believe that they could be a solid 
step towards solving the problem eventually, and possibly, with an affirmative answer. 

In the design of budget feasible mechanisms, due to the sharp budget constraint, the major 
approach used by previous works, e.g., [SOlEllTO], is based on a simple idea of adding agents one 
by one greedily and carefully to ensure that the budget constraint is not violated. Our mechanisms 
use another simple, but powerful, approach: Random sampling. We add agents into a test set 
T with probability half each and compute an optimal budgeted solution on T (to derive efficient 
computation, a constant approximation to the optimum suffices). Note that all agents in T are only 
for the purpose of 'evaluation' and will not be winners anyway. The computed optimal solution on 
T gives a close estimate to the optimal solution of the whole set with a high probability. We then, 
using the evaluation from T as a threshold, compute a real winner set from the remaining agents. 
Random sampling appears as a powerful approach and has been used in other domains of mechanism 
design, e.g., digital goods auctions [13], secretary problein [21 [l], social welfare maximization [9], 
and mechanism design without money [7] . It is intriguing to find applications of random sampling 
in other mechanism design problems. 

Related Work. Our work falls into the subject of algorithmic mechanism design, which is a 
fascinating field initiated by the seminal work of Nisan and Ronen [T7]. There are two main 
threads in algorithmic mechanism design: approximate social welfare with efficient computation or 
with frugal payment; our work belongs to the latter. 

As mentioned earlier, the study of approximate mechanism design with a budget constraint 
was originated by Singer [20] and constant approximation mechanisms were given for additive and 
submodular functions. The approximation ratios were later improved in [6]. Dobzinski, Papadim- 
itriou, and Singer [10] considered subadditive functions and showed an 0(log n) approximation 
mechanism. They also considered cut function, which is a special non-monotone function, and gave 
constant approximation mechanisms. Ghosh and Roth [12] considered a budget feasible mechanism 
design model for selling privacy where there are externalities for each agent's cost. 

In an independent work, Badanidiyuru, Dobzinski, and Oren [3] considered maximizing social 
welfare for subadditive functions with a knapsack constraint and gave a 2 + e approximation al- 
gorithm with demand queries. We consider the same problem and present a 4 + e approximation 
algorithm; the algorithm is used as a subroutine in our truthful mechanisms. However, the focus 
of our paper is completely different from [3]: ours is on truthful mechanism design, whereas [3] is 
on social welfare maximization. 



2 Preliminaries 

In a marketplace there are n agents (or items), denoted by A. Each agent i ^ A has a privately 
known incurred cost c{i) > 0. For any given subset 5 C ^4 of agents, there is a publicly known 
valuation v{S), meaning the social welfare derived from S. We assume that f(0) = and the 
valuation function is monotone, i.e., v{S) < v{T) for any 5 C T C A (in Section [5l we will discuss 
how to remove the monotone assumption). 

We will consider XOS and subadditive functions in the paper; both are rather general classes 
and contain a number of well studied functions as special cases, e.g., additive, gross substitutes, 
and submodular. 

• Subadditive (a.k.a. complement free): v{S) + v{T) > v{S U T) for any S,T C A. 

• XOS (a.k.a. fractionally subadditive): There is a set of linear functions fi, ■ ■ ■ , fm such that 
v{S) = max {/i(5), f2{S), ■ ■ ■ , fm{S)} for any S (^ A. Note that the number of functions m 
can be exponential in n = |^|. 

Another definition is that v{S) < X^2-g2-4 ^(^) ■^(^) whenever '^x-ieT ■'^i'^) — ^ ^°^ ^^^ i € 5", 
where < x(T) < 1 and 2 is the power set of A. That is, if every element in S is fractionally 
covered, then the sum of the values of all subsets weighted by the corresponding coefficients 
is at least as large as v{S). Feige |llj showed that the two definitions are equivalent. 

Our objective is to pick a subset of agents with maximum possible valuation given a sharp 
budget B to cover their incurred costs, i.e., max^^-^ t'(<S') given c{S) = X]ies'^(^) — ^- However, 
agents, as self-interested entities, have their own objective as well; each agent i may not tell his true 
privately known cost c{i), but, instead, submit a bid b{i) strategically. We use mechanism design 
and its solution concept truthfulness to manage strategic behaviors of the agents. Upon receiving 
b{i) from each agent, a mechanism decides an allocation 5 C ^4 of the winners and a payment p{i) 
to each i £ A. We assume that the mechanism has no positive transfer (i.e., p{i) = ii i ^ S) and 
is individually rational (i.e., p{i) > b{i) if z € 5). 

In a mechanism, agents bid strategically to maximize their utilities, which is p{i) — c{i) if f is a 
winner and otherwise. We say a mechanism is truthful if it is of the best interest for each agent to 
report his true cost, i.e., b{i) = c(i). For randomized mechanisms, we consider universal truthfulness 
in this paper: a randomized mechanism is called universally truthful if it takes a distribution over 
deterministic truthful mechanisms. 

Our setting is a single parameter domain, as each agent has only one private parameter which 
is his cost. It is well- known [16] that in the single parameter setting, a mechanism is truthful if 
and only if its allocation rule is monotone (i.e., a winner keeps winning if he unilaterally decreases 
his bid) and the payment to each winner is his threshold bid (i.e., the maximal bid for which the 
agent still wins). Therefore, to the end of designing a truthful mechanism, it suffices to design a 
monotone allocation. 

A mechanism is said to be budget feasible if its total payment is within the budget constraint, 
i-G-! SiP(^) ^ B. Assume without loss of generality that c{i) < B for any agent i € A, since 
such agent will never win in any budget feasible truthful mechanism. We evaluate a mechanism 
according to its approximation ratio, which is defined as max^ °m(i\ ' '^^ere M.{I) is the (expected) 
value of a mechanism M on instance / and opt{I) is the optimal value of the following problem: 
maXg(-^ v{S) subjected to c{S) < B. Our goal in the present paper is to design truthful budget 
feasible mechanisms for XOS and subadditive functions with small approximation ratios. 



3 A Sub-Logarithmic Approximation Mechanism 

In this section we give an o(logri) approximation truthful mechanism for subadditive valuation 
function. Note that the representation of a subadditive function usually requires exponential size 
in n. Thus, we assume that we are given access to a demand oracle, which, for any given price 
vector p{l), ■ ■ ■ ,p{n), returns us a subset T € argmax5cA (^(5') — Ylies P^"^)) • ^ demand oracle 
enables us to evaluate the values of the function f (•), and a polynomial number of queries can be 
asked in a polynomial time mechanism. 

3.1 Subadditive Function Maximization with Budget 

We first describe an algorithm that approximates m.axscAv{S) given that c{S) < B. That is, we 
ignore for a while strategic behavior of agents and consider a pure maximization problem where 
the objective is to pick a subset with maximum possible valuation under the budget constraint. 
Dobzinski et al. [10] considered the same question and gave a 4 approximation algorithm for the 
unweighted case (i.e., the restriction is on the size of selected subset). Our algorithm extends their 
result to the weighted case and runs in polynomial in n time if we are given a demand oracle. 
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Lemma 3.1. SA-ALG-MAX is an 8 approximation algorithm for subadditive function maximization 
given a demand oracle. 

Proof. Let S* be an optimal solution. Note that v{S*) > v* = maxi^Av{i) and c{S*) < B. For 
all V < v{S*), we first prove that the algorithm will generate a non-empty set Sy with v{Sy) > |. 
Since T is the maximum set returned by the oracle, we have 

»(T)-5^c(r)>„(5-)-^c(5-)>.-^^B>| 

Hence, v{T) > |. If c{T) < B, then Sy = T and we are done. Otherwise, by the greedy procedure 

v{Sy) < I. Then 



of picking items from T to Sy, we are guaranteed that c{Sy) > -j. Assume for contradiction that 



v{T\Sy)-^c{T\Sy) > v{T)-v{Sy)-^{c{T)-c{Sy)) 

> v{T)-^--^c{T) + ^-^ 
^ ^ 4 2B ^ ' 2B 2 

= .(T)-^.(T) 



The later contradicts to the definition of T, since T \ S^ is then better than T. Thus, we always 
have v{Sv) > | for each v < v{S*). Since the algorithm tries all possible f € V (including one with 

^2 < V < v{S*)) and outputs the largest v{Sv), the output is guaranteed to be within a factor 
of 8 to the optimal value v{S*). D 

Note that we can actually modify the algorithm to get a 4 + e approximation with runtime 
polynomial in n and -. To do so one may simply replace V by a larger set {ev*, 2ev*, . . . , [^]ef*}. 
Both algorithms suffice for our purpose; for the rest of the paper, for simplicity we will use the 8 
approximation algorithm to avoid extra parameter e in the analysis. 

We will use SA-alg-max as a subroutine to build a mechanism for subadditive functions in the 
subsequent section. When there are different possible sets maximizing v{S) — YliesPi''')^ ^^ require 
the algorithm to compute a fixed set T (i.e., the result will be the same for all possible answers on 
oracle queries). This property is important for truthfulness of our mechanism. To implement this, 
we assume that there is a fixed order of all items ii ~i 12 ~< ■ ■ ■ ~< in- We first compute 

Ti G argmax ( v{S) — /^p(i) I and T2 € arg jxiax ^ ( v{S) — /^pii) 



i£S ^ "_-XL"-.J \ ■g_5 



SCA\{n} 



If vij^x) — J2i£T Pi^) ~ ""(^2) — SieT P(^)> ^^ know that there is a subset without ii that gives us 
the maximum; thus, we can ignore ii for consideration. If v{Ti) — X^jgj'^ p{i) > v{T2) — J2ieT2 Pi^)-- 
we know that ii should be included in any optimal solution; hence, we will always include ii and 
proceed the process iteratively for 12,13, ■■■ ,in- One can see that this process gives a fixed outcome 
that maximizes v{S) — Yl,i(^sPi^)- 

3.2 Mechanism 

In this section, we will describe our mechanism for subadditive functions. 
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In the above mechanism, we first sample in expectation half of items to form a testing group T, 
and then use SA-alg-max to compute an approximate solution for items in T given the budget 
constraint B. As it can be seen in the analysis of the mechanism, the computed value v is in 
expectation within a constant factor from the optimal value of the whole set A. That is, we are 

6 



able to learn the rough value of the optimal solution by random sampling. Next we consider the 
remaining items A\T and try to find a subset X with relatively big value in which every item 
willing to "share" the budget B at a fixed share -^. (This part of our mechanism can be viewed as 
a reversion of the classic cost sharing mechanism.) Finally, we use the information v from random 
sampling as a benchmark to determine whether X should be a winner set or not. 

The final mechanism for subadditive functions, which we denote by SA-mechanism-main , is a 
uniform distribution of the above SA-random-sample and the following one which simply picks 
a single item with the largest value. 



mechanism-largest-item 

• Let I £ argmaxi t;(z) be the winner. 

• Pay all budget B to the winner i. 



Theorem 3.1. SA-mechanism-main runs in polynomial time given a demand oracle and is a 
universally truthful budget feasible mechanism with an approximation ratio o/0( j °j^" ). 

To the end of proving the claim, we first establish the following lemma. 

Lemma 3.2. For any given subset S (^ A and a positive integer k, assume that v{S) > k ■ v{i) 
for any i (z S. Further, suppose that S is divided uniformly at random into two groups Ti and T2. 
Then, with probability at least ^, we have v{Ti) > -ji^v{S) and f (T2) > -^v{S). 

Proof. We first claim that there are disjoint subsets Si and ^2 with SiU S2 = S such that v{Si) > 
-^v{S) and v{S2) > -^v{S). This can be seen by the following recursive process: Initially 
let Si = and 52 = S; and we move items from 52 to Si arbitrarily until the point when 
v{Si) > -^v{S). Consider the 5i,52 at the end of the process; we claim that at this point, we 
also have v{S2) > -^v{S). Note that v{S) < v{Si) + v{S2)- Let i be the last item moved from 
52 to Si; therefore, v{Si \ {i}) < ^v{S), which implies that v{S2 U {i}) > ^v{S). Thus, 
t;(52) + vii) > v{S2 U {i}) > ^v{S). As v{i) < ^^(5), we know that t;(52) > ^v{S) > ^v{S). 

Consider sets Xi = 5i n Ti, Yi = 5i PI T2, X2 = 52 fl Ti and 1^2 = 52 fl T2. Due to subadditivity 
we have ^v{S) < v{Si) < v{Xi) + viYi); hence, either v{Xi) > ^v{S) or v{Yi) > ^v{S). 
Similarly, we have that either v{X2) > -^v{S) or ^(^2) > ^^v{S). Clearly, partitioning Si into 
Xi,Yi and partitioning 52 into X2, Y2 are independent to each other. Therefore, with probability 
^ the most valuable parts of 5i's partition and 52 's partition will get into different sets Ti and T2, 
respectively. Thus the lemma follows. D 

Proof of Theorem \3.1[ Let S = A\T. It is obvious that the mechanism runs in polynomial time 
since SA-ALG-MAX is in polynomial time. If the mechanism chooses mechanism-largest-item, 
certainly it is budget feasible as the total payment is precisely B. If it chooses SA-random- 
SAMPLE, either no item is a winner or X is selected as the winner set. Note that \X\ < k and each 
item in X gets a payment of -^. It is therefore budget feasible as well. 

(Truthfulness.) Truthfulness for mechanism-largest-item is obvious (as the outcome is irrelevant 
to the submitted bids). Next we will prove that SA-random-sample is truthful as well. The 
random sampling step does not depend on the bids of the items, and items in T have no incentive 
to lie as they cannot win anyway. Hence, it suffices to only consider items in 5. Observe that every 
agent will be a candidate to the winning set only if c(i) < -^. Consider any item i € 5 and fixed 
bids of other items. There are the following three possibilities if i reports his true cost c{i). 

7 



• Item i wins with a payment -^. Then we have c{i) < -^ and his utihty is -^ — c(i) > 0. If i 
reports a bid which is stih less than or equal to ^, the output and all the payments do not 
change. If i reports a bid which is larger than -^, he still could not win for a share larger than 
-^ and will not be considered for all smaller shares. Therefore, he derives utility. Thus for 
either case, i does not have incentive to lie. 

• Item i loses and payment to each winner is -^ > c(i). In this case, if i reduces or increases 
his bid, he cannot change the output of the mechanism. Thus i always has zero utility. 

• Item i loses and payment to each winner is -^ < c{i) or the winning set is empty. In this 
case, if i reduces his bid, he will not change the process of the mechanism until the payment 
offered by the mechanism is less than c{i). Thus, even if i could win for some value k, the 
payment he gets would be less than c{i), in which case his utility is negative. If i increases 
his bid, he lose and thus derives zero utility. 

Therefore, SA-random-sample is a universally truthful mechanism. 

(Approximation Ratio.) It remains to estimate the approximation ratio. For any subset Z C A, 
let OPT{Z) denote the optimal solution over the agents in Z under the budget constraint; and 
OPT = OPT{A) denote the optimal solution for the whole set. 

If there exists an item i e A such that v{i) > \v{OPT), then mechanism-largest-item 
will output an item with value at least 2'^{0PT) and we are done. In the following, we assume 
that v{i) < 2v{0PT) for all i & A. Then, by Lemma 13.21 with probability at least 2 we have 
v{OPT{T)) > \v{OPT) and v{OPT{S)) > \v{OPT). Hence, with probability at least \ we have 

v{OPT{S)) > v{OPT{T)) > -v{OPT). (1) 

8 

Therefore, it suffices to prove that the main mechanism has an approximation ratio of Q( io°i^"„ ) 
given the inequalities ([I]). 

Since SA-alg-max is an 8 approximation oiv{OPT{T)), we have v > lv{OPT{T)) > ^v{OPT). 
Clearly, if SA-random-sample outputs a non-empty set, then its value is at least gm°^^ • v > 

srioto "n 'v{OPT). Hence, it remains to prove that the mechanism will always output a non-empty 
set given formula ([T]). 

Let S* = {1, 2,3,..., m} C 5 be an optimal solution of S given the budget constraint B and 
ci > C2 > • • • > Cm- We recursively divide the agents in S* into different groups as follows: 

• Let ai be the largest integer such that ci < — . Put the first in.m{ai,m} agents into group 
Zi. 

• Let /?r = cti + ■ ■ ■ + dr- If /3r < m let a^+i be the largest integer such that c^^_,_i < - — ; put 
the next minjar+i, m — /3r} agents into group Zr+i- 

Let us denote by x+1 the number of groups. Since items in S* are ordered by ci > C2 > • • • > Cm, 
we have Or+i > Or for any r. If there exists a set Zj such that v{Zj) > °m°^" • v, then the 
mechanism does not output an empty set, as it could buy aj items at price — given that SA-alg- 
max is an 8-approximation and the threshold we set is v{Zj) > gm°^^ • v. Thus, we may assume 



that v{Zj) < °Q]°g " • V for each j = 1,2, . . . ,x + 1. On the other hand, by subadditivity, we have 

x+l 

J^v(Zj) > v{S*) = v{OPT{S)) > v{OPT{T)) > v. 

i=i 

Putting the two inequahties together, we can conclude that {x + 1) ■ °m°^" ■ v > v, which imphes 

that 

5 log n 5 log m 

X > > . 

log log n log log m 

On the other hand, since S* = {1, 2, 3, ... , m} is a solution for 5 within the budget constraint, 
we have that Ylf=i Cj < B. Further, since a > ^^, c^^+, > -^^, ..., c^^^^ > ^^;^+i , we have 

EB aiB OixB 

i=i 

Hence, 

1 ai ax 1 ai oix 



ai + l a2 + 1 otx+i + 1 2ai 2a2 '^otx+i 

In particular, we get 



„ . 1 tti , , ax-i . ^ I ai Ox-i 
2 > \ \ \ >xa . 



ttl 02 dx V CHl Ct2 Oix 

where the last inequality is simply the inequality of arithmetic and geometric means. Hence, we 

get 2 > x^/-^, which is equivalent to ax > (f)^- Now plugging in the fact that tti > ax and 

> — ogm_ come to a contradiction. This concludes the proof. D 

— log log m ' '^ 

4 Integrality- Gap Approximation Mechanisms 

The mechanism SA-mechanism-main gives a sub-logarithmic approximation for subadditive func- 
tions. The next question one would ask is whether there exists a constant approximation truthful 
mechanism. In this section we give another mechanism attempting to answer this question. Our 
mechanism has an approximation ratio which equals to the integrality gap of a linear program. For 
special cases when the integrality gap can be bounded by a constant (e.g., all XOS functions have 
integrality gap 1), our mechanism will have a constant approximation ratio. 

For simplicity, we will first present our mechanism for XOS functions. Next in Section [4.21 we 
will discuss how to generalize it to subadditive functions. 

4.1 XOS Functions 

We will first consider XOS functions. Given an XOS function v{-), by its definition, assume that 
v{S) = max{/i(5), /2(5), . . . , /m(5')} for any S (^ A, where each /,(•) is a nonnegative additive 
function, i.e., fj{S) = "^i^zg fjii)- Note that the value m may not be bounded by a polynomial of 
n = \A\. 

In our mechanism, we use a random mechanism Additive-mechanism for additive valuation 
functions as an auxiliary procedure, where Additive-mechanism is a universally truthful mecha- 
nism and has an approximation factor of at most 3 (see, e.g.. Theorem B.2, [6]). 
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XQS-RANDOM-SAMPLE 

1. Pick each item independently at random with probability i into group T. 
1. Compute an optimal solution OPT{T) for items in T given budget B. 

3. Set a threshold t = ^(0PT(T)) ^ 

4. Consider items 1t\. A\T and find a set S* G arg: max {v{S) ~ t ■ c{S)\ . 

SCA\T *• -' 

5. Find an additive function / with f{S*) ^ v(S*) in the XOS representation of u(-) 

6. Run Additive-mechanism for function /(•) with respect to set S* and budget B. 

7. Output the result of Additive-mechanism. 



In the above mechanism, again we use the approach of random sampling to evaluate the optimal 
solution and use this information to compute a proper threshold t for the rest of items. Specifically, 
we find a subset S* with the largest difference between its value and cost, multiplied by the threshold 
t (in the computation of S* , if there are multiple choices, again, we pick one according to a fixed 
order). Finally, we use the property of XOS functions to find a linear representation of v{S*) and 
run a truthful mechanism for linear functions with respect to S* . Note that the runtime of the 
mechanism is exponential. 

Consider the threshold t, subset S* , and additive function / defined in the XOS-random- 
SAMPLE. We have the following observation. 

Claim 4.1. For any S C S* , f{S) - t ■ c(5) > 0. 

Proof. Suppose by a contradiction that there exists a subset S ^ S* such that f{S) — t ■ c(5) < 0. 
Let S' = S* \ S. Since / is an additive function, we have c{S') + c{S) = c{S*) and f{S') + f{S) = 
f{S'uS) = f{S*) = v{S*). Thus, 

v{S') - t ■ c{S') > f{S')-t-c{S') 

= v{S*)-t-c{S*)-{f{S)-t-c{S)) 
> v{S*)-t-c{S*), 

which contradicts the definition of S*. D 

The following claim is critical for truthfulness. 

Claim 4.2. // any item j € S* reports a different cost h{j) < c{j), then set S* remains the same. 

Proof. Let b be the bid vector where j reports b{j) and others remain unchanged. First we notice 
that for any set S with j G S, {v{S) — t ■ 6(5)) — [v{S) — t ■ c{S)) = t(c(j) — 6(j)) is a fixed positive 
value. Hence, 

v{S*)-t-b{S*) = v{S*)-t-c{S*) + t{c{j)-b{j)) 
> v{S)-t-c{S) + t{c{j)-b{j)) 
= v{S)-t-b{S). 



^Indeed, in the second step of the mechanism, we can use SA-ALG-max to compute an approximate solution, 
which suffices for our purpose. Step 4 can be done easily by a demand query. Hence, if we are given an access to 
an oracle which, for any subset X of items, gives a linear function / with f{X) = v{X), then the mechanism can be 
implemented in polynomial time. 
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Further, for any set S with j ^ S, we have 

v{S*) - t ■ b{S*) > v{S*) - t ■ c{S*) 
> v{S) - t ■ c{S) 
= v{S)-t-b{S). 

Therefore, we may conclude that 5* = arg max [v{S) — t ■ 6(5)) . D 

Our main mechanism for XOS functions, denoted by XOS-mechanism-main , is simply a uni- 
form distribution of the two mechanisms mechanism-largest-item and XOS-random-sample. 
We have the following result. 

Theorem 4.1. The mechanism XOS-MECHANISM-MAIN is budget feasible, universally truthful, 
and provides a constant approximation ratio for XOS valuation functions. 

The theorem follows from the following lemmas. 

Lemma 4.1. The main mechanism XOS-mechanism-main is universally truthful. 

Proof. Our mechanism is a combination of two mechanisms, in which mechanism-largest-item 
is obviously truthful. Therefore, it remains to prove that XOS-random-sample is truthful. To 
this end, since all items are single parameter, it suffices to show that XOS-random-sample is 
monotone, that is, a winning item will still be in the winning set with a smaller bid. Assume that 
item i is in the winning set of XOS-RANDOM-SAMPLE. If i decreases its bid, then by Claim H?2] and 
the rule of the mechanism, S* does not change. When the mechanism runs Additive-mechanism 
for S* with respect to additive function /(•), since Additive-mechanism is a truthful mechanism, 
i will still be in the winning set when decreasing its bid. Therefore, XOS-random-sample is 
monotone, and thus, truthful. D 

Lemma 4.2. The main mechanism XOS-MECHANISM-MAIN is budget feasible. 

Proof It suffices to prove that both MEGHANISM-LARGEST-ITEM and XOS-RANDOM-SAMPLE are 
budget feasible. Clearly, mechanism-largest-item is budget feasible. XOS-random-s ample 
uses a budget feasible mechanism Additive-mechanism as a final output for winning set and 
payments to them. Therefore, threshold payments in XOS-random-sample can be only smaller 
than those in Additive-mechanism providing us that XOS-random-sample is budget feasible 
as well. n 

Lemma 4.3. The main mechanism XOS-MECHANISM-MAIN has a constant approximation ratio. 

Proof. Let OPT denote the optimal solution given budget B, and let k = minjgoPT ^\(i) ■ Thus 
v{OPT) > k ■ v{i) for each i G OPT. By Lemma O we have v{OPT n T) > ^v{OPT) with 
probability at least i. Thus, if we denote the optimal solution of T given budget B by OPT{T), 
then we have v{OPT{T)) > v{OPTnT) > ^v{OPT) with probability at least i, as OPT nT is 
a particular solution and OPTt is an optimal solution for set T with budget constraint. 

We let OPT* be the optimal solution with respect to the item set S* , additive value function / 
and budget B. In the following we will show that f[OPT*) is a good approximation to the actual 
social optimum v{OPT). Consider the following two cases: 
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c{S*) > B. Given the condition, we can always find a subset S' Q S*, such that -j < c{S') < 
B. By Claim El we know f{S') > t ■ c{S') > <opt(t)) _ b > v{OPTiT)) _ ^^^^ ^^ ^^^ ^^^^ 
that OPT* is an optimal solution and S' is a particular solution with budget constraint B, 
we have f{OPT*) > f{S') > <opt(t)) ^ ^^(^Qprp-j ^j^j^ probability at least |. 

c{S*) < B. Then OPT* = S*. Let S' = OPT\T; thus, c(5') < c{OPT) < B. By 
Lemma [3.21 we have v{S') > -^v{OPT) with probability at least ^. Recall that S* = 
arg max {v{S) — t ■ c{S)). Then with probability at least ^, we have 

f{OPT*) = f{S* 



■ B 



v{S*) 






viS*) 


-t-c{S*) 




v{S') - 


-t-c{S') 




k-1 

-j 

4k 


'j{OPT) - 


v{OPT(T)) 
8B 


k-1 
4k ^ 


'j{OPT) - 


v{OPT) 
8 


k-2 


'j{OPT). 





In either case, we get f{OPT*) > mm{^v{OPT), ^v{OPT)} > ^v{OPT) with proba- 
bility at least 2 ■ Then in the last step of our mechanism XOS-RANDOM-sample, we use the output 
of Additive-mechanism(/, S*, B) as our final output. Recall that Additive-mechanism has ap- 
proximation factor of at most 3 with respect to the optimal solution f{OPT*). Thus, the solution 
given by XOS-random-sample is at least \ ■ f{OPT*) >\-\- ^v{OPT) = ^v{OPT). 

On the other hand, since k = mini^oPT ^ r\ ? the solution given by MECHANISM-LARGEST- 
ITEM satisfies maxjf(z) > ^v{OPT). Combining the two mechanisms together, our main mecha- 
nism XOS-mechanism-main has performance at least 

' '~' + It} <0PT) = ^^v[OPT) > ^viOPT). 



2 384A; 2 kj ^ ' 768k ' ' " 768 

This completes the proof of the lemma. D 

4.2 Subadditive Functions 

Here we use our results of the previous subsection for XOS functions to design a truthful mechanism 
for subadditive functions. Let ^i, . . . ,Si\f be a permutation of all possible subsets of A, where 
N = |2 I is the size of the power set 2 . For each subset S* C ^, consider the following linear 
program, where there is a variable Oj associated with each subset Sj. 

N 
LP{S) : min /^Oj ■ v{Sj) 

i=i 
s.t. aj>0, l<j<N 

y ^ aj > I, y i € S 

j: ieSj 
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In the above linear program, the minimum is taken over all possible non-negative values of a = 
(«!, . . . ,a]\f). If we consider each aj as the fraction of the cover by subset Sj, the last constraint 
implies that all items in S are fractionally covered. Hence, LP(S') describes a linear program 
for the set cover of S. For any subadditive function v{-), it can be seen that the value of the 
optimal integral solution to the above LP(5) is always v{S). Indeed, one has S C |J . ^^-^ Sj and 

Let v{S) be the value of the optimal fractional solution of LP (5), and T{S) = %a\ be the 
integrality gap of LP(5'). Let I = max5'cA2^(5'); the integrality gap X gives a worst-case upper 
bound on the integrality gap of all subsets. Hence, we have -^^ < v{S) < v{S) for any S '^ A. 
The classic Bondareva-Shapley Theorem (5l[T9] says that the integrality gap I{S) is one (i.e., v{S) 
is also an optimal fractional solution to the LP) if and only if f (•) is an XOS function. 



Lemma 4.4. v{-) is an XOS function. 

Proof. For any subset S '^ A, consider any non-negative vector 7 = (71, . . . , 
Ej: ies- 7i — 1 ^^^ ^^y i & S. Then, we have 



77V ) > that satisfies 



N 



N 



N 



5^^j-«™-5, Z]^j>-^(^^^) 



i=i 



/3.>0 



N 



, fc=l 



Vie 5,-, Yl /3,,fc >l 



k: ieSk 



\j=l fc=l 



y j,y i e Sj, ^ /3j,fe > 1 



fc: i(zSk 



''- \k=i ^j=i ^ 



Vj,ViE5j, Y. /^i.fe^l 



k: iGSk 



N 



^ ™ii? E"^-^^'^^ 



Q>0 



v{S) 



, fc=i 



V i G S, y^ Ofc > 1 

k: ieSk 



The inequality above follows from the fact that for any i € 5, 

E E^i^i'^ = E^i E ^i,fc>E^i- E ^i-i- 

k: ieSk 3 3 k: ieS^ 3 3- i^Sj 

Hence, v{-) is fractionally subadditive, which is equivalent to XOS. 

We are now ready to present our mechanism for subadditive functions. 



D 



SA-MECHANISM-MAIN-2 

1. For each subset S'^A, compute v{S) . 

2. Run XOS-MECHANISM-MAIN for the instance with respect to XOS function w(-) . 

3. Output the result of XOS-MECHANISM-MAIN. 
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Theorem 4.2. The mechanism SA-MECHANiSM-MAiN-2 is budget feasible, universally truthful, 
and provides an approximation ratio of 0(1) for subadditive functions, where recall that I is the 
largest integrality gap of LP{S) for all subsets. 

Proof. Note that the valuations v{-) are pubhc knowledge; thus computing v{-) and run XOS- 
MECHANISM-MAIN with respect to v{-) do not affect truthfulness. The claim then follows from 
Theorem 14.11 and the fact that ^^^ < v{S) < v{S) for any S C A (i.e., using v{-) instead of v{-) we 
only lose a factor of X in the approximation ratio) . D 

5 Extensions 

In the current section we consider two extensions for valuation functions where the mechanisms 
described before still can be applied. 

5.1 Non-Monotone Functions 

In general, f (•) can be a non-monotone subadditive (or XOS) function, e.g., the cut function studied 
in ^Q\. That is, for any S* C T C ^, it is not necessarily that v{S) < v{T). We next describe how 
to apply our mechanisms to non- monotone functions. 
For any subset S Q A, define 

v(S) = maxu(T). 

TCS 

Clearly, {)(•) is monotone and inherits the classification of v{-); that is, if v{-) is subadditive (or 
XOS), so does ■0. Note that given a demand oracle, v{-) can be computed easily. Then we can 
apply our mechanisms to v{-) directly. Further, we have the following observations. 

• For any subset S Q A, let OPT{S) be an optimal solution of f (•) on S. Then OPT{S) is an 
optimal solution of v{-) on S as well. In particular, this implies that v{-) and v{-) will have 
the same optimal value on the whole set and testing set in random sampling. 

• In mechanism XOS-RANDOM-SAMPLE, the computed S* € argmax5cyi\T {^(5') — t ■ 0(5)} 
is an optimal solution for max5CA\r {^(5') — t • 0(6")} as well, i.e., v{S*) = v{S*). Let / be 
the linear function with f{S*) = v{S*) = v{S*) computed for v{-). Note that in f{S*), each 
item i € 5* has a non-negative contribution to the value of f{S*) (otherwise, S* will not be 
an optimal solution). Hence, we can run Additive-mechanism for additive function /(•) on 
S* , which yields the desired result. 

Therefore, all our mechanisms described above continue to work for non-monotone functions with 
the same approximation ratios. 

5.2 Relaxed Subadditive Functions 

A valuation function v{-) is called /C-subadditive if for any disjoint subsets Si, S2, ■ ■ ■ ,Se C A of 
items, v{Si U 52 U • • • U Si) < JC ■ {v{Si) + ^(52) + ■ ■ ■ + ^(5'^)) . Note that a function is subadditive 
in the usual sense if and only if it is 1-subadditive. 

For this case we may consider another valuation function: For any 5" C A, define 

v{S) = min < v{Si) + v{S2) + • • • + v{Se) | ^i, . . . , 5^ is a partition of 5 >. 
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Note that v{-) approximates v{-) within a factor of /C, that is, IC-v{S) > v{S) > v{S). It can be seen 
that this new function is subadditive. Thus, by applying our mechanisms to v{-), we lose an extra 
factor of /C in the approximation ratio with respect to the optimal solution of f (•). In particular, 
when /C is a constant, our mechanisms will have the same order of approximation ratio. 

6 Special Examples 

In this section we consider a few concrete examples of XOS and subadditive functions. The main 
purpose of which is to illustrate how general scheme works in particular settings, and give cer- 
tain evidence that the general approach is natural and can be efficiently implemented in certain 
circumstances. 

6.1 Matching 

In the instance of matching, we are given a (bipartite) graph G = {U,E), where each edge e & E 
corresponds to an agent with a value v{e) and a privately known cost c(e). For any subset of edges 
S (^ E, its value v{S) is defined to be the total value of the largest matching induced by the edge 
set S. It is well known that matching is not submodular (e.g., edge (1*3,^4) contributes one to the 
set {{ui,U2), (ii2)^3)} but contributes zero to {{u2,U3)} when all edges have unit value). However, 
matching is in the class of XOS functions; hence, our mechanism XOS-mechanism-main gives a 
constant approximation. 

We argue that our mechanism XOS-RANDOM-SAMPLE, and thus, XOS-MECHANISM-MAIN, can 
be implemented in polynomial time for matching. In random sampling, computing an optimal 
solution for the testing group T is equivalent to solving a maximum weighted matching problem 
with a budget constraint, which admits a polynomial-time approximation scheme [1]. (Note that 
similar to SA-mechanism-main and its subroutine SA-ALG-MAX, it is not necessary to compute 
an optimal solution for the testing group; any constant approximation suffices to our mechanisms.) 
The set S* can be computed according to the following simple subroutine: for each remaining edge 
e € E \T we set the new value w{e) = v{e) — t ■ c(e) and then compute a maximal matching 
with respect to w in the induced subgraph E \T; this forms the set S* . Finally, for this given 
selected matching S*, its valuation is already additive with respect to its members. Therefore, the 
implementation can be done in polynomial time. This gives the following claim. 

Proposition 6.1. XOS-mechanism-main is a constant approximation mechanism for matching 
and can be implemented in polynomial time. 

6.2 Clique 

Given a graph G = {U, E), each vertex i is an agent with a value v{i) and a privately known cost 
c{i). For a given subset of vertices S (^ U, its value v{S) is defined to be the value of the largest 
weighted clique in 5, i.e., v{S) = max { X^jgT'v(0 | 7" ^ S* is a clique}. Note that clique is not 
submodular as well (e.g., consider a graph with vertices {ii,i2,i3,H} of unit value each and edges 
{(^1)^2), (^i,u)> (^2,^3)) (*2>u)}; the contribution of ii to {^2,^3} is zero, but to {^2)^3,^} is one). 
Further, it can be seen that clique is an XOS function (this follows simply from the definition of 
v{S)). Hence, given a demand oracle, SA-ALG-MAX computes a subset whose value is a constant 
approximation to the optimal solution. In addition, the set S* can be computed by a single demand 
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query; and the linear function for v{S*) can be found easily by demand queries for elements in S* 
one by one. Hence, we have the following claim. 

Proposition 6.2. XOS-mechanism-main plus subroutine SA-alg-max gives a constant approx- 
imation mechanism for clique and can be implemented in polynomial time given a demand oracleo- 

6.3 From Cost Minimization to Valuation Maximization 

In this section we will consider our motivating example discussed at the beginning of the Introduc- 
tion. A company serves a set A of agents (or jobs). Let 7^ denote the set of solution spaces, i.e., 
all possible ways to serve the agents. For any r € 7?-, there is a cost function /r(-) which gives the 
running cost to serve different subsets of agents by solution r. For any subset S '^ A, we want to 
spend as little cost as possible. Hence, the cost to the company is given by 

c{S) =mm{friS) I r G7^}. 

The model includes a number of well-studied problems. For example, in job scheduling, 7^ cor- 
responds to all possible assignments between jobs and machines; in facility location, 7^ includes 
all combinations of facilities to open; and in congestion games, 7^ gives all possible assignments 
between agents and resources. For each of these minimization problems, the cost of the whole set 
c{A) gives the value of an optimal solution. 

Assume now the company would like to remove some of the agents from A by paying them a 
certain amount of subsidy. Our objective is save the running cost as much as possible. Hence, for 
any S C A, we can define 

v{S) = c{A)-c{A\S). 

That is, the valuation of S is equal to the difference of the costs between the whole set A and the 
remaining set A\S. 

Proposition 6.3. If c{-) is a supermodular function, then v{-) is a submodular function. 

The above claim applies to, e.g., congestion games when the latency functions are polynomials 
with positive coefficients (thus the cost function is supermodular); hence, our mechanisms can be 
applied, as well as mechanisms specifically designed for submodular valuation [201 [6]. When c(-) is 
a submodular function, it can be seen that v{-) is neither submodular nor subadditive. However, 
in some examples (e.g., in job scheduling, the cost is a square root function with respect to the 
total length of scheduled jobs), we can show that v{-) is a relaxed subadditive function, and our 
mechanisms therefore can be applied. 

Our model links cost minimization problems with budget feasible mechanism design. For a vari- 
ety of problems, e.g., facility location, and job scheduling with various minimization objectives, the 
valuation function v{-) defined above may not necessarily fall into the class of (relaxed) subadditive 
functions. The design of budget feasible mechanisms with small approximations for these problem 
is an intriguing question, which we leave for future work. 



^Our result does not contradict to the hardness of max-chque approximation. Indeed, given the access to powerful 
oracles, even a simple value query of the whole set will give the value of an optimal clique solution. 
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